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Previous research has indicated that children 
comprehend acre of aaterial of high interest than saterial of lov 
interest, vhen each child is given a sizture of t>oth types. In th9 
present study of fifth-grade children, each child received either all 
high-interest aaterial or all lov-interest aaterial. Interests vere 
assessed using a picture-rating technique. One veek later, each child 
read cloze passages corresponding to that child's highest or lowest 
rated topics. Cloze responses were scored both fpr exact feplacesent, 
and for use of synonyas. Besults indicated. that children coaprehended 
aore of high-interest than of lov-intere^t aaterial, suggesting that 
the interest effect is not dependent upon selective re^onse to the 
aore appealing passages in a aixed set^ The scoring of synonyas 
yielded useful data, indicating that hagh-achievln'g children and boys 
produced aore synonyas than did lov-achieving children and girls. 
(Author/AA) 
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Children's Comprehension 



Abstract 




The pr^esent study investigated chi I dreads comprehensfon of reading 

material which was of either high- pr low-interest. Previous research 

indicates that childreH comprehend more of high- than low»r interest 

material When each child is gi Ven a mi xtgre of 6oth types of material. 

This effect could be due to a contrast effect whereby chlldreti selectively 

.respond to the more appealing passages Tn their spt pf passages. In , 

* ■ * ■ • ^ 
' * - ■■• * 

the present study^'each child receivesd either all high-interest passages 

or all ' low-interest passages but not both. Fifth grade children*^ 

interests were assessed using a pTcture rating techni^que. One week 

later each child read c^oze passages corresponding to the child's ^ 

highest or lowest r^ted topics. Children's cloze respgnses were scored 

by the typical exact repl'acement method and by a method which included 

synonyms as correct. Results were that chi Idren comprehended more of 

high- than low- interest material, suggesting that the interest effect 

is not dependent on a contrast phenomei^n. Synonym production data 

indicated|Jjg|f high- achieving children generated more synonyms than 




low-achifBrnif chi I dren and that boys produced more synonyms thatjt gj r Is.. 



In contrast to the of t-statod.:Concfusion in the I i tera^Jjiire, there appears 
to be some informational value of scoring synodfyms as correct. 

3 * 
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Children's Comprehension of High- and Low-Interest Material and a 
Comparison of. Two Cloze Scoring Methods 

Recent evidence indicates that children's reading comprehension is 
affected by their level of interest in the content of the material ^ 
(Asher and Markell, 1974)..^ Fi fth-grade children's interests were 
indivi dual ly assessed using a picture-rati ng technique. Children rated 
the interest value of each of 25. photographic slides. One week later 
each child received six passages, three of which corresponded to his or 
her highly-rated topics,/'and three of which corresponded to topics 
that were rated low. ^Xl I passages were presented in cloze format . 
(Taylor, 1953) with/every fifth word deleted. The child's task was to 
read thfe passage and replace each o '"^ the missing words. 

Asher and l^arkel I 's findings ircficated, that gills' reading per- 
formance was slightly affected by their interest in the reading material 
and that boys' perforrnance was strongly affected by the interes.t level 
of the material. On low-interest material and on a school-administered 
reading achievement test,. boys performed significantly poorer than girls. 
However, on the high-interest material the sex difference was el iminated. 
jhese results have potentially Important implications for the assessment 
of children'^s reading abi lity; giving chi Idren passages .of low Intercast 
may seriously underestimate some chl Idren's abi I ity ^to^gain information 
from written materi/al. 
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The research methodology In the Asher and Markel I study represents 
an advance ovei; earlier investigations of the effect of interest on 
reading comprehension. One element is the individualized assessment 
of children's interests independent of any particular reading material. 
In one study (Schnayer, 1967), children's lITl^^rest in a topic was 
measured after they read a passage on that topic and had been tested 
for comprehensipn. This procedure confounds the reading comprehension 
measure wfth'ttie interest assessment procedure. Children's interest 
reports could be a function of eitlier their comprehension of the material 
or its topic appeal. In other studies, normative data on children's 
interests have i^eer/ used to se^lect passages OBernstein, 1955; Klein, 1969; 
Stanchf ield,^96/). Since individual children's Interests differ from 
group norms^rt^g. not all boys like basketball), using group norms 
instead of/ndividual assessfnent Introduces consM^j^^e experimental 
error. ^/ 

Second, the Asher and Markel I study used a large number of passages 
sampled from a wide array of reading topics. In much of the previous 
research only two passages have been used, one which is supposedly 
high-Interest and the other which Is intended to be of low-interest (e.g. 
Dorsel, 1975; Klein, 1969), This restricted sampling increases the 
likelihood that results obtained are limited to the particular passages 
employerd. '"^ \ " • v» . ^ 
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Finally, the use of the cloze procedure a^ a measure of compre- ' 
hension has several advantages:' (I) it provides objective and repl^cable 
procedures. for creating test items on any given sample of reading material 
(2) It produces reliable scores; and (3) cloze scores correlate highly 
with standardized reading achievement test scores (Bormuth, 1967; 1968; 
Rankin and Culhane, 1969). Previous studies of interest effects often 
have used reading achievement tests specifically developed for each study 
with no prior demonstration of test reliability or validity (Bernstein, 
1955; Stanchf ieltj^ 1967). In many cases item selection appears to have 
been arbitrary. 

The present study focuses on two ^sues. First, the generality of 
the Asher and Markell findings is examined/ In their study each child 
received both high-interest and low-interest passages.' It is conceivable 
that the results obtained were dependent on ^ contrast,' effect whereby 
children selectively responded to the more i nterest i ng passages in their 
set of materials. Rarely in the school day are children assigned reading 
material that provides such clearly Identifiable variation in topic ' 
appeal. In the present study, -the possibility that a contrast effec^ 
would operate was eliminated by employing a between-subjects design in j 
which each child was given either afl high-interest or all low-interest 
passages. No effect of interest would be expected if the effect is \ 
dependent on a contrast phenomenon. If, however, the Interest effect 
is not dependent on a contrast effect then the origina.l f Indi ngT\hou Id ^ 
be replicated with a between-subjects design. 
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The second issue exami ned in the. present research is whether .the 
vaMdity of the cloze procedure is increased by accepting synonyms, as 
well ^s exact replacements of the dele-^d words. Asher and Markell (1974) 
scored a response as correct only if it. was an exact replacement or a 
misspelled exact recJIacement of a deleted word. This procedure follows 
the of tr cited cone I us ion* that accepting synonyms does not increase the 
vaUdity of the procedure and only Increases inefficiency and subjectivity 
of scoring (Bonriuth, 1965; Jongsma, 1 974; . Tay lor, I953), 

There may be^ reason to question the generality of this conclusion. 

Most studies favoring the'' use of exact replacement scoring system^^av^ 

used passages rather than individual' readers as th^unlt of analysis. 

Cloze scoring methods are compared in terms of how they dKscrlmlnate 

passages which vary in-»readlng difficulty level . Two most frequently ^ 

jcited studies are by Taylor (1953) ^and Bormuth ('I965P. Using a small 

sample of readers (N = 12) and pasflBes <N = 3), Taylor. ( 1953) compared 

* * 

an exact scoring method with a weighted scoring method in which partial 
credit was given for synonym replacef]n|efits. The weighted scoring method 
raised scores for each of the -3 passag^ but did not change the ranking 
of the passag0%in terms of^ff i' culty. In a more? extensi ve study, 
with 50 reader^ and 20 passages, Bormuth (1965)* found that the exact ^ 
replacement method discriminated among the passages sligff^^ly better 
than the exact plus synonym scorlmj-frt^thod.' ♦ I 

A\^ough this exact method best discriminates' amgng passages, the 
exact plus^synonym method might best discimlnate between individual 
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readers. For example, readers who comprehend mpre of a passage might 
produce more synonyms than poorer readers. A few studies have compfared 
' various Aloze scoring systems using the individual- as th^^Bni t of analysis, 
The approach has^Been to correlate cloze scores with achievement test 
scores to' determine which scoring method produces the highest correlation. 
Bormuth (1965) found that th6 exact replacement score corre latq^d - . 82 

with achie^ment scores while a score based on the^humber of syhonyms cor- 

* ■. • • 

related .64 with achievement scores. Unfortunately^ an exact' plus 

^ A • ' ' 

synonym scoring category was nofl^ncluded fn^these analyses. The cor- 
relation of an exact plus synonym scorirjg system with achievement scores 
Is the critical test; a scoring system based on synopyms alone would i 
not I i ke ly be used. • 

One study which compared exact and/exact plus synonym scoring systems 
was dcjne by Ruddel I (1964). Six di fferenT' passages were \ised. For all 

six pftssages th3 split-ha^f reliability coefficients were higher with 

V . ' - ^ ; 

the exact plus synonym scs>res than ''for the exact replacement scores. For. 

^ two of the passages the difference was sijr^f^ikant. • Ruddel I found^^/(b 

^ significant differences in the validity of the exact and exact >p1us 

synonym scoring methods as measured by correlations of cloze scores on 

each' passage ^ith achievement scores. However, 5 of the '6 corjrelations 

with exact plus synonym ^scores were slightly higher than thosk with exact 



scores 
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In another study which compered scoring systems, Schoel les (1971) 
\jfpund higher correlations between exact plus^ synonym scores and achieve- 
ment tfest scores than between exact replacement scores artd ^achievement 
scgres. For second grade cftf tdren,.4'he correl^atlon' for exact plus 
synonym scJ^res was .94, an(i for the exact scores, .89, ^or sixth graders 
the exact pi us • synonyiJi scores correlated .82 wftti acJhievement scores and 
th J, exact scores corr^-lated .3J3. ^ ^ 



It seems, then, that scdring synonym^s^ correct ^does not alter the 
fribution of passage scores' but it may inrkience the way in which thef 
res of indi vi dual readers are distributed. ..However, interpretation 



of previous research is made particularly difficult, si ncQ on Ly ,Rudde+l 
(1964) has provided Information on^^gw synonyms were defined and none of 

tfte studies have reported 'data on how reliable judges are in deciding 

( , ' \ / ■ 

whether a response is a synonym. 



The present study examined vjba^er the oorrelatlon of children's 
cloze scores and their reading achievement test scores I ncre^ses by 

/ v ... 

accepting synonyms as correct. The present study also investigated 
whether the. production of synonyms is^if ferentTal ly affected by the 

interest level of the material. ^If /children are more motivated on high- 

1 ■' ' 

Interest material, then they might\)poduce more synonyms as well as more 

^ ' - ^• 

exact responses. Alternati vely, ^chi I dren Ji^^^ht be^.less familiar with 

the vocabulary on low-inteT^st mat^iM^al, resi^lting in the production of 

more imprecise but near-correct responses of this type of material. 

V 

Finings regarding the production of synonyms, then, could be suggestive 

9 
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of the type of proqesses that'are operating wh^a children read high* 
and low- interest material. 

^ Method 

Subjects ^ , ^ 

The study was conducted eighteen months after Asher and MarkelM-s 
In the same schooj and grade lev^l. .Seventy-five chi I dren rpar:tlcipated. 
They constituted the entire fifth-grade population of the IsthodP, except ^ 



for four children, who were repeatedly pbsent. Achievement' test data, 
from fh6 school-administered Scholastic Testing Service Educational 
Development Series read 1 ng achievement test v(^e available for 71 of 
the 75 children. Accordfng ly/ four children were eliminated for the 



sample. AnotJJBr c^ 11 d assigned to the low-Interdst condition was elimin- 
vatQ(jdbec&dse even her f I ve- lowest rated topics averaged above the midpoint 
o^ the- scale. Of the final sample of 70 children, 38 were girls and 32 
were boys. The children/s average IQ on a school-administered STS 
Educational Development Series ability test was 107. 

Materi al s 

Interest SH des. . 



Twenty^flve color slides were used to assess interests. Each slide 
represented a singly theme pr topic and the topics covered a wide range 
of interest af^^aip. The topics are listed befow In the randomly selected 
order In whlcfi^they: *(^re presented t^o children.^. 
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I /' Forest 

2. Jet Ai rpl'ane \ 

3. Priest. ' 

4. Dogs 

5. AsKf^auts 
6* &rld4 

7. Calf 

8. Basketbal I 

9. Butte rf I les 



10. Marionettes 

I I . Monkey 

I?. Flowers 

13. But If Ighting 

14. Skiing 

15. Food 

16. Li vi ng Room 

17. Maps 

18. Painting 



19. Circus. 

20. Race Gars 

21. Canoe- 

22. Model Trains 

23; Mother and /Chi Id 

24. Insects 

25. Cats 



Reading Materials * ^ ^ ♦ 

. Twenty-five passages from the Britannica Junior Encyclopedia (1970) 
were used. This source was originally selected by Asher and Markell ( I974r 
because It is written for elementary school children In the fourth grade 
or above (Walsh,> !97!5J and provides a wide r-ange of topics in a more con- 
'sistent style than**would be obtained trom diverse sources. The pa'ssages. 
corresponded In topic to the* 25 photographs. Each passage was transformed 
Into a ten Item cloze passage by de I eting|^» 'tenth word and every ''f ifth^ 
word thereafter. An enti re, sentence fol lo15^ the last deletion. Each ' 
deleti^ was replaced with a 15-space line on Which children could print 
their rep lac?e^nts. ' •. ' 



Procedure 




The iriiterfist 



t and the reading corrll^rehensl^ task were- 



administered in two separa,t6^ ses^lon^ohe week apart.' The childreh were 
tested in/their classrooms diiring their reading period. Different experl- 
adml n I 



menters 



ilstered "^he two sessions to minimize the possibility that 



children would perceive the ^nnectlon between the Interest assessment and 



the reading activity. 
« 
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Interest Assessment 



Experimenter I told the children, "l.'d like to find out about -what 
kids are interested in. I'm gcJrig to show you 25 s I i des.'-. Forlpach slide 



yKios are inieresTec in. rm go^g to show you /5 suaes.-. T 
MO I FRe^you to mark, on the sheets we^MI give you, .how inferesflng the 
picture is to you. Who knows^ what 'interesting* means?" After a -l%w 
Children had responded. Experimenter .1 summarized thpi r comme.nts by sayfng, 
"So, something is interesting when you like it and would like to find out 
more about it." Experimenter I then distributed t^fj^each ch? Id a form . 
with twenty«f|^ve 1-7 rating scales, and drew a l«7 jpcaHe on the b Ijack^'. 
^ board. At fhe low* end of %ech. scale Were the ^p^dsx^ot at ail interesting 
and, ^ tfye high. 6nd, "very interesting." The(hature and use o| the rating 
scale "f/ere explained:. , . I 

"If 'a picture««^is very interesting to you — if yqu like it very much^ 
and want to know more about it— mark a number al* this end o'fi^ the scale. 
(The experimenter pointed to Numbers 5, 6, and 7 of the scafe on the black- 
, board.) You can mark it with a circle, an X, a check, or whatever you want 
If a picture i.s not at all Interesti ng .to' you— i f you don^t like (t and 
wouldn't- car^ to find out more about it — mark a number at the low en^ of 
flK scale. (The experimenter pointed to the Numbers 1,2^ and 3 of the 
scale.) If the picture is of medium interest to you — if yoi/llke it but 
don't I i1<e it a lot--mark a rvumber here. (The experimenter pointed to ' \ 

* 

dumber* 3,4, and"5.) Let's try an example for practice. ' If I showed 
a picture of a pi le of dol lar bills, what number would yo^u fchdose? (The 
-^experimenter ^ca I led on several students.) If I showed a picl^re of a . piece 
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^rlmenter 



ofxd'irt, what number would you choose? (The experimenter again called 
ort several students. ) So ya# can see that differept people are Interested 
In different things. If anyone has any questions, raise your hand and 
IMl try to answer them. (Experimenter I then presented the slides 
announcTng the number of each one as It was projecte;j.^ Here's Picture 
Number I Here's Picture Number '2 ..^p etc." 

The slides wer6 presented at the rate of approximately one every 10 
seconds. When all pictures' had been rated, the children were asked 
write their names on their rating sheet. 



Reading (comprehension Task 

One week after the Interest assessment. Experimenter '2 gave the child- 
ren five cloze passages to read. Children were randomly assigned to either 
the high- or low-Interest conditions. Those In the h Igh-lnterdst condition 
rece/ved cloze passages t^at corresponded to their five highest-rated 
pictures. Those in the low- interest condition received cloze passages 
that corresponded to their five lowest-rated pictured. When topics shared 
the fifth highest or fifth lowest ratings they werev^andomly selected ^ 
from those topics sharing equal ratjjTgs. Five passages were used because 



the sixth lowest-rated topics, on the average, tend to be moderately 
rated. Using six passag^ per child would therefore have weakened the 
high-versus low-interest manipulation. 

Each of the five cloze passages, t^ppropri ate ly titled In upper-case 
letters, was mimeographed on 8 1/2 X 5 1/2- inch paper and enclosed in a 
legal-size envelope. The envelopes were numbered from one to five to 
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specify tho order In which the pass^es were to be read. The fwrticular 
order of the five passages was randomly a»6lgned for each child. In 
addition to these five envelopes each child received an additional envelope 
which contained a reading enjoyaient scale. The purpose of this scale was 
to learn whether ch 1 1 dron In thehigh* Interest condl t ion 'enjoyed their 
material morh than children in the low- Interest condition. The Item was: 
"I enjoyed the paragraphs I just' finished reading," Below the Item was a 
1-7 scale with "disagree" under the "r and "agree" under the "7". ' 

Before children were given the envelopes, E>ct>erlinenter 2 gave "^he - 
fol Ic4lng Instructions: 

"I am going to show you a reading game. (Experimenter 2 gave Qach 

^ rf • 

Child a sample paragraph.) This Is a paragraph with some words missing. 

The idea is to read the paragraph and decide what words are missing. Each 

« 

paragraph has 10 missing spaces. Take a minute to look at the paragraph. 
(The experimenter paused.) OK. -Now I'll read the paragraph with all of 
the words in it. You follow along with me. (The experimenter read the 
sample paragraph aloud, collected the sample paragraph from each child'and 
then gave each child tho test envelopes.)". 

" You now have six en>felopes. ' Five have paragraphs in them. Start 
with the first paragraph and try to fill In all the missing words. When 
you are done with a^||ragraph, put it back in the envelope and put it aside 
or^J^ur desk. Then you can go on to the second envelope; then the third, 
fourth, and fifth. Once you put a paragraph back in the envelope you can't 
go back. Do you have any questions?' OK. Read each paragraph carefully 
and try to fill in the missing words. I Can't help you read any of the 
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words, but If you have trouble spelling any words |;^se your hand and I 

1 1 help. Spelling doesn't count In this game. If you are having 
trouble, don't get s^uck. Go on' to the next blank or a new paragraph. 
You have 40 minutis for the five paragraphs. T||^t should be plenty of time. 
Any questions:?" 

"When you are done with the five, paragraphs, open the next envelope. , 
It contains a question about how much you enjoyed rlfcdlng th*# paragraphs* 
If you enjoyed it very much circle one of the higher numbers. '^T^you 
didn't enjoy It, circle one of the' low numbers. Yop can circle one of 
the numbers In the middle If that is how you feel. Got the Idea?' Any 
questions? OK. You can begin." 

When each chl^d was finished. Experimenter 2 collected the material 
and unobtrusively recorded the time. The average time for completing the 
task was 18 minutes. 

# 

Cloze scoring method 

Eaq^child received two scores, one based on the number of exact 
replacements supplied and one based on the^umber of exact replacements 
plus synonyms. Supplied words were counted as correct despite spelling 
errors if the supplied word was clearly recognizable. Since there were 
five passages with ten deletions each, a child's score coald range from 
0-50. 

A rule was needed for deciding whether a response w|is, a synonym. A 
Thesaurus offers an objective basis for deciding about synonyms; however, 

15 / I 
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many, passage wordSfwere not I ist^TTthef-e. ThOTScoring procedure used here 
was as follows: One person, blind to the experimental hypotheses, scored' 
the pas'sagos tor exact replacements only/ (spelling err6rs were allowed), 
and then I isted-on- separate sheets of pap^r the Incorrect responses that; 
children provided for each iteff. The§e responses- were I fsted/dl rect ly 
under a heading wfflch was the»^c6rrect responser. These lists were then , 
glv^n ta three Judges (I male and 2 female college sfuiJent^) who'were 
also unaware of the purpose. of the e-xperlment. Judges were Ins^^cted 
to put a check mark next to each of the responses that wer^ synoftymous with 
the correct response. ^ ' - 

The ln5t^uctlons given to the Judges fqr Identifying words af synonyms 
were as fol lows: 

"The fol lowT?t^M|fcLnition of synonyms will be used: A Is a synonym 



# 



ave th( 



of B if A and B havethe same meaning, i The task here requires your 
judgments on whaf we call 'synonyms in context' . A and 8 are synonyms In 
the context of a passage If they maintain the meaning of the sentence aa 
of the passage Intended by i'he author. Therefore in jud^i^ng-^Wbrds as 
to whether or not they are synonyms in the context of the passage you 
should check that part of the bassage Immediately before and fmrnedlately 
after the blank. Read the so/ftence In which the blank Is found and the 
sentence fol lowing it so you get the Idea the author is trying to get 
across." 
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"In judging words as synonyms, remember that speljijig errors don'r 
count unless they lead to i change in tense or number (e.g.» choose and^ 



boy should not be thought of as Incorrect spelling of cbgge and boys )> 
The synonym In context must be of the same tc^se and numben ai^the original 
word; thus, was and is are not synonyms In context nor are remand are , 
•Jhe words inust also be of the same grammatical case; thus we and iH.af^*" 
not anonyms In 'context. The words must be grammatically corre^:tM«lth res- 
pect to the- sentence, thus ^ and an^ would nqr be synonyi 



7- 



About an hour of training was provided on completely unrelated passages 
tb'ensur^e that judges understood the task and the definition of a l&ynoriym. 



Inter judge agreement (number of ' agreements divided by the total number 



of items) averaged 93? befween each pair of Judges (Judge A and B = ^ 

93?; Judge B and C = 95$; Judge A an^ C = 92?). However, synonyms ^ 

bccurreud Inf requent-ly (children averaged only 2.8 synonyms out of 50 

deletions). Most of the non-exact responses that children produced 

I 

were clearly not synonyms. Because of the high number of non-synonym 
Judgments, a strong agreement among judges would be expected by chance. . 
Thus the 95C figure may not be an accurate indication of reliability 
of synonym judgments. A more apjiropriate measure of agreement for 
these data is kappa, K (Cohen, I960; Light, 1^71), which calculates 
the proportion of joint judgments in which there is agreement after 
chance agreement is excluded. The k value obtained for this data was 
-615, Z = 2.730, p<.or. Table I pr'esents observed and expected agree- 
ments and disagreements of the synonym judgments. As can be seen in 
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for a synonym If his or her non-exdct replacement was Judged to be a 
synonym by at least' two 'of the three Judges. 

. Results 

' • \ 

Standard! ze(^ Reading Ach lVvemenj ^ . \ 

The STS EducatlonarOevelopment Series reading achtevament test had 
been administered by the school prior to the study, Data from the test 
were analyzed to learn >^hether males and fimales differed In their 
standardized test performapcfe and whether ch I f^fren fendomly assigned to 
htgh- and low-lnt^est conditions wer^of similar readJng ability. The 
reading comprehension score for boys was*29.3 and for girls was 28.5. 
The difference Js not statistically significant, t f68) = .32. Further 
Inspection of achievement data Indicated that despite random assignment 
to condition, boys in the low-Interest condition (X = 31.7) tended to 
be higher achievers than boys in the high-Interest qqndltfon (X = 26.6), 
t (^30) = Iv65, p< .15. According!-/, analyses performed here on the effect 
of Interest on children's performance Osed sfe^ndSS^^d reading scores 



as a covariate. In this way any potent ia I ly confound irfg^.effects of 




EKLC 



reading ablMty on performance •In high- ^nd low- Interest condiit'oris 
were statistically removed. 
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the- table', all agreements among JJd^^concer'nlng both synonyps (S) 
and non-synonyms (S)* are higher than would be expected by chance. Al I 
disagreements are less than would, be expected by. chahpe. Thus, synonym 
judgments were found to^ be reliable. Each child received, credit / 

Insert Tab le I here , - ' 



r 



4 Children's Comprehension 

^ ' 17 

Preference Ratings 

The post-reading preference ratings made by l^l^^and girjs In the 
high- and low-Interest conditions were first domparedir^A 2x2 (Sex x 
Interest) analysis of covarlance was performed with the preference rating 
as the dependent variable and standardized reading achievement scores as 
the covarlate. The adjusted ratings are presented ink the top spanner of 
.Table 2. Results indicated that children who received tt)e high-interest 
Mterial expressed significantly more Enjoyment than cht Idren who received 
low-inteaest material, F_ (1,65) - 4^.18, p< .05. i|Bbys and gjlpls -rated ^ / 
the reading material similarly, £ (1,65) = .15, and the int^aWNon ^ 
between sex and interest was not significant, R (1,65)= 1.43. Both 
boys and girls, then, preferred the passages that corresponded to their ^ 
high-interest areas. These results Validate the use of the picture rating 
technique stnce thfe picture ratings predicted the reading preferences for 
both sexes. ^ . ' 

~- — — ■•--r'-- — --r-- ' 

Insert Table' 2 about here 



Reading (^mpreheasi on 

Next, the effects of sex and interest on children's readiVig compre- 

i 

hension were examined. To facilitate comparison with Asher and Markell's 
findings an analysis was first performed on dlo:e performance based on 
exact replacements only. 2 x 2 (Sex x Intf^rost) analysts of covarlance 
was performed with standardized read^^ achievement scores as the covariate 
and cloze scores as the dependent variable. Results of this analysis 
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(ml dd le .spanner, Table 2) Indicated that the effect of Interest was ^ r 

■ i ^ 

significant, IF (1,65) ^ 4,41, p< ,05, wi^M-h ch 1 1 dnen/comprehendmg more 
of high- than low- Interest material, A second result was that the . 
"'effect of sex was not significant, R (1,65) = .SB, Thl,s finding 

4 

parallels the lackof a significant sex difference on the standardized \ 
reading achievement test. Finally, the interact I or)^ of sex anfli Interest 
was not significant, F^ (J, 65) = .OZ, The lack of interaction resuli-ed 



>f Asber 



from the fact that botJ) boys and girls did better 'orf||'he high-li 
than low- interest materlat.y^This OMtr^sts with th( 

and Markel I (1974) whd ,i&hfiK3rai<2^ performance was strongly inyfluenced 



the in teres 




performance was not. 



Another x intew^jC/cbvar lance analysis was performed with reading 



achievement scores as the covariat^'and the exact plus synolhym scores 
as the . dependent mqgfeure. The adjusted exact plus synonym cloze scores 
are -presented in the bottom spanner of Table 2. This analysis produced 
findings similar to those* using exact rep4acement scores-. The effect of 
interest was marginally significant, F_ (1,65) = 3,65, p< ,06, 'the "effect 
of sex was not s 1 gni f leant, £ (1,65) =1.31, and the interaction of sex 
X interest was n^t significant, F^ (1,65) = .02. The effect of scoring 
syijonyms as correct was to increase the average correct cloze score 
for the total sample from 14.0 to 16.8 and to increase the standard 
deviation from 7.2 to 8.5. The^fact that the interest effect is sIFghtly 
weaker here is probably due to the increased variability associated with 
including synonymS as correct. ^ 
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The slightly-elevated standard deviation suggests that the effect 
of scoring synonyms was to som^hat widen the gap between good ahd/poor 
reraders. To examine directly whether higher acfvlevers produced more 
synonyms than low achievers the sampla'^^was divided at the median achieve- 

J 

ment tesT score and a 2 x 2 x 2 (Sex x Interest x Achievement Level) 

^ r 

analysis of variance was performed with number ofisynonyms as the dependent 
measure. These data are presented tfl Table 3. As expected, the effect 
of achreve/nentvl^er, was significant, F (1,62) = 23.21, p< .001, with 
higher achlevi^^g^hi I dren producing more synonyms than lower-achieving 
children. Tr>e effect' of sex was al3o significant, F tl,62) = 6.0S., ^ 
P< .05 with boys procjuci ng more synonyms ^an girls. The effect of 
interest was not signl f iipant, £(1,62)**= .27; chl I dren produced a similar 
number: of synohyrtis in the high- an<J low-Interest conditions. Norte of. 
the interactions between the main, ef fects^ere significant or approached 
significance. . 

Final ly^* ana lyses were performed to compare the relationship of 
standardized reading achievement test scores to cloze scores when^only 
exact replacements were accepted versus' exact replacements plus synonyms. 
For the total sample the correlation between standardized achievement 
test scores and cloze scores based o^x exacf; replacements only was £ (68) = 

.49, p< .05. The correlation when cloze scores incTuded synonyms was 

J! 

£ (68) = .53, p< .05. This small change in the correlation follows from 

the fact that the correlation between the two types of cloze sct)res Is * 

» 
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very high, £.(68) = .98, p< .001. Synonyms were low frequency resjaonses. 
Even ^though certain children produced wore synonyms than others the 
occurrence of synonyms,.W3S.^too infrequent to alter greatly the distribution 
of cloze scores. * \ 

7 

Discussion 



-Results of this experiment pair^ia'l ly' cep^icate and partial ly qualify 
earl ier« findings . Using the exact replacement scorfng' system tradition- 
ally employed, children were fc^nd, to rea^etter on high- than low- 
interest material. This result indicates that the effect of Interest is 
not dependent on contrast effects that might be part of a wi thin-subjects 
design. ChMdren performed better on high- interest passages even when 
they were unaware^'gf^ the range of topics aval lablTTpythe experiment. In 
this sense, the present experiment, with a feWtween-subJects design, repli- 
cated the original findings of Asher and Markel I (1974). 

The results qualify the original findings insofar as sex and interest \^ 
did not interact; both boys and girls did better on high- than low-interest 
material. Asher and Markel I found that boys* performance* was strongly 
affected by the fe^ntent of reading material while girls* performance was 
only slightly afiected. One difference between the two experiments iS 
the type of resear<:h design employed. However, the potential role of this 
factor is probably minimal given some other. recent data. In a study 
examining interest effects on black and white children's reading compre- 
hension, boys and girls were tested with a wi thin-subjects design (Asher, 1976) 

y • ■ 
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Boys and girls of both races performed better on hf^tj^than low-interest 

material- Apparently, then, 'the effect of interest on comprehension for 

« 

girls is not a function of the type pf.->c;esearch design employed. 

I Another explanation has to do'with possible secular or cultural 
changes. Girls in the past may have been mor^ willing to work hard on a 
task even though it was uninteresting. Perhaps changing def in i tions ^f 
sex-roles are leadifvg^gi ris to be less oriented toward meeting external , 
st^ntteirds and more concerned with internal criteria such as theix Interest 
in the task. The rather^short time interval between the original study 
and the present ex^^eriment r^akes this interpretation highly speculative 
but nonetheless possibly correct. 

Perhaps the most plausible interpretation is that the type of interest 
effects obtained is a function of th'fe developmental level of the children 
tested. The boys and girls in Asher and MarkelMs study were significantly 

9a;jYnc 



different on the school -admin i stered rea^mig achievement test, with girls 



achieving higher scores, ^j^' contrast, boys and girls In the. present 
study aVid the other recent study (Asher, 1976) did not significantly differ 
on the same test. All three studies were conducted with fifth grade 
children. From previous literature it appears that sex differences in . , 
reading comprehension are Jn aN^ransi tiona I phase about this age level 
(Gates, 1961; Hughes, 1953; Stroud and Lindquest, 1942) with sex differences 
in comprehens ion rather consistently obtained with younger children, non- 
existent at later ages, -and inconsistently obtained in fifth grade. 
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One Intriguing possibility is that the gap ^n achievement test p-en 
forman^e narrows in the later years not simply because boys "catch «p" 
but because girls^^^ome motivated to excel pnly If the task Is appealing 
to them. In thl5 ^,se, girls, like boys, would begin to shts^ effects of 
Interest, on their reading comprehension. They, too, would be particularly,^ 
motivated when the material fs appealing to read. If Kais interpretation 
is ^ccg::rect then studies at grade levels where sex dffferences typical ly 
occur*Te.g.<^ fourth grade) should find strong interest effects ' for^^^boys 
and weaker effects for girls. Studies at grade levels where boLs and 

girls typical ly perform a I Ike (e.g. sixth grade) should show Ifmllar ^ • 

I 

effe^cts of interest for both sexes. Thus further research Is needed 
to establish the conditions under which the'^terest effect is obtained 
for both sexes versus boys only. 

Another purpose of the present e))[)eriment was to assess the relative 
correlations of cloze performance v^ith standardized test performance when 
synonyms are not accepted as correct responses. The data support 

the findings of Ruddel I (1964) that including synonyms only slightly 
increases the correlation of cloze scores with standardized achievement 
test scores. However, inspection of the perfWmance of dpfferent groups 
of children suggests that scoring synonyms as cO'rrect does have differential 
effects across children;* Children who are higher achievers produced 
more synonyms efe well a^^^jn)bre exact responses. In addition, boys were 
found to ^produce a significantly greater number of synonyms tha^n girls. 

24 
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These findings suggest that, depending on the purpose'.of an experiment, 
"it qiay be useful to score synonyms as correct. Jhe general bias in the 
I iteratu/e against aQcept[ng synonyms may be lead^jng- ±5 the Joss of valuable 
informaH-ion >when the individual rather than f he ^ssage \% the unit of . 

/ \ ■ ■ 

ana lysi s. • v * i • 

»A final purpose of ^he present study was to examine whether 'chl I dren 
♦produce more or less synonyms on h i gh- ipter^ft" mater i aj . The finding was 
that a similar number of syhonyms was produced on high- and low-interest 
material. Thus it seems un I i kel v ttiat the inclusion of .synonyms wi I i 

T •■' , — - • . '^ - • 

substantial ly alter the pattern of results obtained in studies of interest, ^ 
effects. Still, the'issue might be re-examined in future research. The 

7 • • ' ■■ ■ 

encyclopedia material 'used in the present research, although 4i/ri1^en for 
children in the fourth grade or above (Walsh, 1973), is quite challenging ^ 
(Afher and Markel I , 1974). Material of a less di ff icul t natuKe might y iel d 
a different pattern of synonym produ9tion. 

/ ■ . 

Part of the bias against accepting synonyms as correct replacements 
results from the decreased scoring bbjectivlty. In the present s-ftiSy, 
the interjudge rel iab i I i ty using coefficient Kaippa was quite satisfactory. 
The scoring of synonyms as correct did not lead to« a serious loss of 
objectivity. As a further caution^ a response was scored as ^ synonym if 
two out of three judges independently so decided. Givea the low prob^b-v<.. 
ility that a judge will ciassify a response as a synonym, this is basical>fcy 
a conservative procedure that resiilts in only a small increase in each 
child's score. Still, the scoring of synonyms produced some interesting 
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f indings acro^sr groups of children,. Fuhjther research wi 1 1 indicate 
^whether the gains irj new -in format ionloutweigh^ the costs of ju^'ng a somewhat 
'more gibmplicated scoring procedure. . * ' • s ^ ^ 

^ Further research is also needed to learn why children read better 
on high* than lowlnterest material. One possibility is that children 
are nrore motivated on higb-int^r'fest passages and attend more, work har^der-j 
e1c. Another possibility is t'hat children comprehend mor^of high-Interest 
material because they are more know^iBdgeable about the content. One 
approach to evaluating these expl anations^ woul d be to provide a strong- 
external incentive for trying hard on both types of i;;eading rhateriak This 
could indicate whether chi I dren are able to comprehend, as much' Of low- 
^gs high-interes(4^ material when they are moti vated^-tq do well on^both. 
Whi\^chevQr explanation of .-t^e interest effect is ultimately supported,, 
it appears that researchers or teachers seeking to assess children's 
competence in reading comprehension havfe reasQp to consider carefully 
their selection of passage topics. Assignment of passages based on an 




individualized assessment of children's interests appears to facilitate 

lomprehensfon. . * 

r ; . ^ . - \ . 



children^'s reading comprehension. 
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Table I 

Agreements and Disagreements of 
Synonym (S) and Non- Synonym (S) Judgments 



Observed 



Judge A 
S S 



Judge B 



S S 



Judge B 
S S 



_„06j 
19 

u 


40 


S 


1052 


28 


71 


Judge C 


~73*' 


83 



:.s 

Judge C ^ 



1068 1 18 
^"74 ~76' 



Expected 



Judge B 



\ 

Judge A 

S S 
1043 I 103 

82 8 



Judge C 




Judge B 
P S 



Judge G ) 



1001 


79 


145 


ir 
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Table 2 

Mean Adjusted Reading Preference Ratings, Exact 
Cloze Scores, and Exact Plus Synonyn Cloze Scores 



Sex 



Interest Level 



Boys ' 



Girls- 



Reading Preference Ratings 



High 
Low 



4. -55 
3. 13 



4:i7 
3.77 



Exact Cloze Scores 



High 
Low 



15.99 
13. 10 



15.30 
11.96 



High 
Low 



19.74 
16.18 



Exact Plus Synonym Cloze Scores 



17.53 
14.41 
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Table 3 

Mean Number df Synonyms Produced 



Interest Level 



Boys 



Sex 



Girls 



High Achievers 5.33 



High 



Low Achievers J 
High Achievers 



Low 



2.33 
4.30 



2.88- 



1.70 
3.56 



Low Achievers 



2.00 



1.45 
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